System for assembling composite group image from individual subject images

ABSTRACT

A system for assembling a group composite image from individual subject images is described. Often subjects of a group vary in height. Additionally, as each subject is photographed individually, different zoom factors can be applied by a camera that affects a pixel density of the image captured. The system includes a fiducial marking device that emits collimated light to form one or more fiducial markers on a subject while an image is captured by the camera. Based on a location of the fiducial markers in the image, a pixel density of the image and a reference height of the subject can be determined. The individual subject image can be scaled based on the pixel density and reference height to account for the varying subject heights and zoom factors to generate a group composite image that accurately represents the subjects of the group relative to one another.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is a Continuation of U.S. application Ser. No.16/731,190, filed on Dec. 31, 2019, the disclosure of which is herebyincorporated by reference in its entirety. To the extent appropriate aclaim of priority is made to the above-disclosed application.

BACKGROUND

A composite group image can be assembled from separate images capturedof individual subjects within the group. Example groups can includeschool groups, sports teams, business or project teams, church groups,and organizational groups, among other similar groups. In someinstances, capturing separate images is preferable over physicallygathering each of the individual subjects in the group to capture animage of the entire group. For example, it can be difficult to gathereach of the individual subjects at a same time and place. Additionally,it can be difficult to have each of the individual subjects lookingtheir best when capturing the image of the entire group.

Individual subjects of a group often vary in height. Thus, whenassembling the composite group image from the individual subject images,it is important to take into consideration a height of each subject toensure the subjects are represented accurately when resizing theindividual subject images for assembly. For example, if height was notconsidered, then an image of a tall adult and an image of a short childwould be resized such that the adult and child are a same size in theassembled composite group image causing the adult to appear shorterand/or the child to appear taller than he or she actually is.

Current techniques for obtaining the height of the subject are limitedto self-reporting by the subject and/or estimation by a photographer,which can be inaccurate. Also, these self-reported or estimated heightsrequire manual entry into an image processing system by thephotographer, for example, leaving further room for error. In additionto heights, zoom factors associated with the individual subject imagescan also vary, leading to further difficulties in accurate scaling orresizing of the individual subject image for including in the compositegroup image.

SUMMARY

In general terms, this disclosure is directed to a system for assemblinga composite group image from a plurality of individual subject images.In one possible configuration and by non-limiting example, the systemincludes a fiducial marking device that causes at least one fiducialmarker to be formed on a subject and captured in a fiducially markedimage of the subject. Based on a location of the fiducial marker, apixel density of the image and a reference height of the subject can bedetermined. A subject-illuminated image of the subject is then processedbased on the determined pixel density and reference height prior toinclusion and arrangement within the composite group image to accountfor a variable zoom factor associated with the image and the height ofthe subject, respectively. Various aspects are described in thisdisclosure, which include, but are not limited to, the followingaspects.

One aspect is a photography method. The photography method includesilluminating a subject with a collimated light, capturing a fiduciallymarked image of the subject with a digital camera, the fiducially markedimage including a fiducial marker formed on the subject by thecollimated light, and determining at least a pixel density of thefiducially marked image and a reference height of the subject based on alocation of the fiducial marker. The photography method further includescapturing at least one other image of the subject with the digitalcamera, and generating a photography product using the at least oneother image, the pixel density of the fiducially marked image, and thereference height of the subject.

Another aspect is a photographic system. The photographic system caninclude a fiducial marking device and a camera. The fiducial markingdevice can include a fiducial light source configured to emit collimatedlight. The camera can be configured to capture a fiducially marked imageof a subject, the fiducially marked image including a fiducial markerformed on the subject from the collimated light. The camera can also beconfigured to capture at least one other image of the subject with thedigital camera, where a photography product can be generated using theat least one other image and values determined from a location of thefiducial marker, the values including a pixel density of the fiduciallymarked image and a reference height of the subject.

A further aspect is a method of generating a composite group image. Themethod can include, for a subject of a plurality of subjects to bearranged in a composite group image: illuminating the subject withcollimated light; capturing a fiducially marked image of the subjectwith a digital camera, the fiducially marked image including a fiducialmarker formed on the subject by the collimated light; determining apixel density of the fiducially marked image and a reference height ofthe subject based on a location of the fiducial marker; capturing asubject-illuminated image of the subject with the digital camera; andbased on the determined pixel density of the fiducially marked image andthe reference height of the subject, processing the subject-illuminatedimage of the subject. The method can further include arranging theprocessed image of the subject among processed images of other subjectsof the plurality of subjects to generate the composite group image.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an example system for assembling acomposite group image from images of individual subjects.

FIG. 2 illustrates an example photography station.

FIG. 3 illustrates a side perspective of a camera and a fiducial markingdevice having at least one fiducial light source.

FIG. 4 illustrates a side perspective of a camera and a fiducial markingdevice having at least two fiducial light sources.

FIG. 5 is a schematic block diagram of a camera.

FIG. 6 is a schematic block diagram of a fiducial marking device.

FIG. 7 is an example of a circuit that drives fiducial light sources.

FIG. 8 is a schematic block diagram of an embodiment of a controller ofa photography station.

FIG. 9 is a schematic block diagram illustrating an architecture of anexample computing device.

FIG. 10 illustrates example composition rules for capturing a digitalimage of a subject.

FIG. 11 illustrates an example image capture sequence.

FIG. 12 is a system flow diagram for assembling a composite group imagefrom images of individual subjects.

FIG. 13 conceptually illustrates a digital image including fiducialmarkers and analysis thereof.

FIG. 14 is an example of a composite group image generated from imagesof individual subjects.

FIG. 15 is another example of a composite group image generated fromimages of individual subjects.

DETAILED DESCRIPTION

Various embodiments will be described in detail with reference to thedrawings, wherein like reference numerals represent like parts andassemblies throughout the several views. Reference to variousembodiments does not limit the scope of the claims attached hereto.Additionally, any examples set forth in this specification are notintended to be limiting and merely set forth some of the many possibleembodiments for the appended claims.

FIG. 1 is a block diagram of an example system 100 for assembling acomposite group image 118 from images of individual subjects 108. Thesystem 100 can include a photography station 102 and an image processingsystem 110. In some examples, the photography station 102 includes acamera 104 and a fiducial marking device 106, and the image processingsystem 110 includes a composite group image generator 112. The compositegroup image generator 112 can include a fiducial marker analyzer 114 anda composite group image assembler 116.

In some examples, the photography station 102 is a structure used by aphotographer for photographing a subject to capture a digital image ofthe subject with the camera 104. Example subjects can include humans,animals, plants, and products or other objects. In some examples, thephotography station 102 is a professional photography studio wherephotographers take photographs of subjects. In other examples, thephotography station 102 is a mobile photography studio, which isportable so that it can be setup at a remote location, such as in aschool, church, or other building or location. In further examples, thephotography station 102 can be an outdoor photography station.

In addition to the camera 104 and the fiducial marking device 106, thephotography station 102 can include one or more backgrounds, one or morelights, and one or more other devices to facilitate and control thecapturing of the digital image of the subject. An example photographystation 102 is shown and described in more detail below with referenceto FIG. 2.

The camera 104 is a device that operates to capture a set of images of asubject. For example, the set of images can include two or three imagescaptured by the camera 104 within an image capture sequence, asdescribed in more detail below with reference to FIG. 11. In someexamples, the camera 104 is a mirrorless digital camera. In otherexamples, the camera 104 is another type of digital camera capable ofcapturing at least three images in less than 100 milliseconds. Anexample of the camera 104 is shown and described in more detail belowwith reference to FIG. 5.

The fiducial marking device 106 is a device that operates to emitcollimated light to form one or more fiducial markers on the subjectwhile an image is captured by the camera 104. The image, hereinafterreferred to as a fiducially marked image, can include the fiducialmarkers. The fiducially marked image can be one image of the imagecapture sequence. The fiducial marking device 106 includes one or morefiducial light sources that emit the collimated light. The fiduciallight sources can be elevated and supported by a stand. In someexamples, the fiducial marking device 106 further includes a beamsplitter or a diffractive optical element. An example of the fiducialmarking device 106 is shown and described in more detail below withreference to FIG. 6.

Once captured, the images of the individual subjects 108 (e.g., the setof images for each subject) can be transferred to the image processingsystem 110. In some examples, the images of the individual subjects 108are stored as image data in a computer readable medium and the computerreadable medium is brought or is transported through a mail deliverysystem to the image processing system 110. Examples of computer readablemedia include memory cards (discussed above), a compact disc (CD), adigital versatile disc (DVD), a hard disc of a hard disc drive, or othertypes of computer readable media. In other examples, the images of theindividual subjects 108 are transferred across a network, such as theInternet (e.g., network), a local area network, or a cable connection,to the image processing system 110.

The composite group image generator 112 of the image processing system110 then generates the composite group image 118 from the images of theindividual subjects 108 transferred to the image processing system 110.The fiducial marker analyzer 114 can determine values for resizingand/or scaling the images of the individual subjects 108 to account forpotentially varying zoom factors applied by the camera 104 when theimages of the individual subjects 108 were captured and heights of theindividual subjects in the group. The composite group image assembler116 can then process the images of the individual subjects 108 based onthe values determined by the fiducial marker analyzer 114 to generate aphotography product for each of the individual subjects 108. In someexamples, the photography products (e.g., the processed images of thesubjects) may then be arranged within the composite group image 118. Inother examples, the photography products may be used individually forother purposes.

To provide an example scenario, colleagues belonging to a project teamare the individual subjects that are being photographed for theircompany's website. The subjects are individually photographed using thecamera 104 to capture the images of the individual subjects 108. Each ofthe subjects of the group vary in height, and as each subject isphotographed, different zoom factors are applied by the camera 104.Additionally, one or more of the subjects may not be positionedcorrectly and/or move as the images are being captured.

For each subject, a set of images is captured and transferred to theimage processing system 110. At least one of the images capturedincludes the fiducially marked image of the subject. The fiduciallymarked image includes one or more fiducial markers formed on the subjectas a result of collimated light emitted by one or more fiducial lightsources of the fiducial marking device 106. Another one of the imagescaptured in the image capture sequence can include a subject-illuminatedimage that is captured independently from the fiducially marked image. Afurther one of the images captured in the image capture sequence caninclude a background-illuminated image. The background-illuminated imagecan be captured independently from the fiducially marked image and/orcaptured simultaneously with the fiducially marked image in a singleframe, for example.

To account for the varying heights of the subjects and the differentzoom factors applied by the camera 104 when each subject wasphotographed, as well as a potential variable position or motion of thesubjects while photographed, the fiducial marker analyzer 114 candetermine a pixel density of images captured for each subject and areference height of each subject based on a location of the fiducialmarkers in the respective fiducially marked image captured for eachsubject. The pixel density is a number of pixels in an image per inch.During the capture of the set of images for a subject, the camera 104often remains stationary and the images within the same set can have thesame the pixel density. However, the pixel density of an image canchange as the camera 104 is moved and zoomed uniquely for the capture ofeach individual subject. Thus, determining the pixel density can accountfor the differing zoom factors applied by the camera 104 as each subjectwas captured. The reference height of the individual subject is avertical pixel location in the image that represents a relative heightof the individual to account for the varying heights of the subjects.Methods for determining the location of the fiducial markers andsubsequently determining the pixel density and reference height aredescribed in greater detail below with reference to FIGS. 11 and 12.

The composite group image assembler 116 can then generate a photographyproduct using at least the subject-illuminated image, the pixel density,and the reference height determined by the fiducial marker analyzer 114.For example, to generate the photography product, thesubject-illuminated image from the set of images may be processed basedon the pixel density and the reference height to ensure that features ofthe individual subjects are represented accurately relative to othersubjects in the composite group image 118. For examples, the compositegroup image assembler 116 can scale the subject-illuminated image basedon the pixel density and the reference height relative to pixeldensities of images captured other subjects and reference heights of theother subjects. Additionally, the composite group image assembler 116can further scale the subject-illuminated image based on a position ofthe subject relative to positions of each other subject in the compositegroup image 118. The composite group image assembler 116 can arrange theprocessed image of the subject (e.g., the photography product) amongprocessed images of the other subjects of the group to generate thecomposite group image 118.

Additional processing of the set of images can be performed by thecomposite group image generator 112. For example, a mask can begenerated, where the mask can be scaled similarly to thesubject-illuminated image. In some examples, the composite group imageassembler 116 performs background replacement using the mask, or performother edits or transformations to generate the composite group image118. Details of the additional processing are described in detail belowwith reference to FIG. 12.

The above description of system 100 provides examples of some of thepossible environments in which a photography station 102 and an imageprocessing system 110 can be implemented. Other embodiments areimplemented in yet other systems or environments. Any of the systemsdescribed herein can be implemented by one or more devices as additionalembodiments.

FIG. 2 illustrates an example photography station 102. The photographystation can include the camera 104, the fiducial marking device 106, acontroller 140, a remote control device 142, background lights 144, abackground 146, a fill reflector 148, a light block 150, a main light152, and a remote computing device 154. Other embodiments can includemore or fewer components. The angles, sizes and relative positioningbetween components in FIG. 2 are not meant to be limiting.

A subject S can be positioned in front of the camera 104. The subject Sis one or more of, or a combination of, a person, animal, or object. Thecamera 104 is a digital camera, examples of which are described in moredetail below and particularly with reference to FIG. 5. The camera 104is in wired or wireless communication with controller 140.

The fiducial marking device 106 includes one or more fiducial lightsources, examples of which are described in more detail below andparticularly with reference to FIG. 6. The fiducial light sourcesoperate to emit collimated light to form one or more fiducial markers onthe subject S during one or more fiducially marked image captures by thecamera 104. In some examples, the fiducial marking device 106 includesone or more stands to support and elevate the fiducial light sources. Acircuit, shown and described in detail with reference to FIG. 7, candrive emission of the collimated lights during the fiducially markedimage captures. The fiducial marking device 106 and/or the circuit is inwired or wireless communication with controller 140. In some examples,the fiducial marking device 106 is also in communication with thebackground lights 144.

The remote control device 142 can be used to initiate the image capturesequence performed by the camera 104. The remote control device 142 isin wired or wireless communication with controller 140. For example,remote control device 142 can communicate with the controller 140 viainfrared signal emission, radio frequency, Bluetooth, Wi-Fi, and otherwireless communication protocols known in the art. The remote controldevice 142 can be a separate physical component with one or morebuttons, an interface on a smart computing device such as a smart phoneor the remote computing device 154, and a button integrated into thecamera 104.

The remote computing device 154 can provide a user interface for thephotographer to input information. For example, the photographer can usethe remote computing device 154 to input information about a photographysession such as a job reference number, information about the subject,order information including types of products, quantity and/or size ofeach type of product, and any requested finishing techniques such as redeye removal, stray hair removal, and blemish removal. Input devices ofthe remote computing device 154 can include a keyboard, a pointer inputdevice, a microphone, and a touch sensitive display. Additionally, theremote computing device 154 can have a reader for scanningmachine-readable codes. For example, in some instances at least aportion of the session information is encoded in a barcode, QR code, orother similar machine-readable code that is scanned by the remotecomputing device 154. Examples of the remote computing device 154 caninclude a desktop computer, a laptop computer, a tablet computer, amobile device (such as a smart phone, an iPod® mobile digital device, orother mobile devices), or other devices configured to process digitalinstructions.

The controller 140 synchronizes the illumination of the backgroundlights 144, the main light 152, and the fiducial light sources of thefiducial marking device 106 with the image capture sequence of thecamera 104. The background lights 144 can be a component of a backgroundlighting system that operate to illuminate the background 146 during oneor more background-illuminated image captures. In some examples, abackground lighting system includes at least two background lights 144,where light from one of the background lights 144 is illuminated for thefirst background-illuminated image capture and light from the other ofthe background lights 144 is illuminated for the secondbackground-illuminated image capture.

In some examples, the background lighting system includes one or morestands to support and elevate the background lights 144. In addition,the background lighting system can include one or more light modifiers,such as an umbrella or soft box, which diffuses the light from thebackground lights 144 to provide the desired lighting pattern anddistribution. The background lights 144 can be a panel of light emittingdiodes, as shown and described in U.S. patent application Ser. No.13/346,471, the entirety of which is hereby incorporated by reference.The background lights 144 can also be a fast-recharge monolight.

The light block 150 prevents most or all of the light from thebackground lights 144 from illuminating the subject S. In some examples,the background lights 144 are oriented substantially orthogonal to thebackground 146, although other angles can be used. The background lights144 and the light block 150 can be positioned such that they do notappear in the image of the subject S captured by the camera 104.

The background 146 is an object arranged in line with the subject S andthe camera 104 to provide a suitable backdrop for images captured by thecamera 104. The background 146 can be a background material or abackground structure. The background 146 often has an exterior surfacehaving a neutral color. In examples, the exterior surface has asubstantially non-textured dark gray color. However, in other examplesthe exterior surface is textured, and/or other colors are used.

When the background 146 is a background material, the background 146 caninclude a frame or stand that supports the background material havingthe exterior surface. In some examples, the background material issubstantially opaque, while in other examples the background material istranslucent. As one example, the background lights 144 can directlyilluminate a rear surface of the background material, and light from thebackground lights 144 passes through the translucent backgroundmaterial, so that it is visible on the exterior surface.

In other examples, the background 146 is a separate object that is not apart of the photography station 102. Examples of such a background 146include a wall, a curtain, a whiteboard, or other structure having anexterior surface that can be illuminated by the background lights 144.

In yet another possible embodiment, the background 146 and thebackground lights 144 are integrated in a same device. In this example,the background lights 144 are positioned behind the subject S and withinthe view of the camera 104, such that light generated by the backgroundlights 144 is directly visible by the camera 104 rather than indirectlyilluminating the background 146. In some embodiments, the backgroundlighting system also includes a display device, such as a flat paneldisplay. Examples of flat panel displays include LED displays, plasmadisplays, digital light processing displays, and the like, many of whichare commonly used as television or computer displays. Such a display canalternatively be arranged behind the background 146 to illuminate thebackground 146 from behind.

The fill reflector 148 is a screen, panel, light or a substantially flatsurface such as a wall. The fill reflector 148 can have low to mediumreflective qualities. Generally, pure reflective surfaces, such as amirrored surface, are not used as a fill reflector. In some examples,the fill reflector 148 is substantially monochrome and can be a white,off-white or gray color. The fill reflector 148 is a way to provide softlight on the left side of the subject S so that the subject-illuminatedimage does not show shadowing on the subject. In the example arrangementshown in FIG. 2, the main light 152 is positioned generally to the rightof the subject S. In that arrangement, some of the light from the mainlight 152 reflects off the fill reflector 148 and onto the left side ofthe subject S.

The main light 152 can be a component of a subject lighting system thatoperates to provide appropriate foreground illumination of the subject Sduring a subject-illuminated image capture. The main light 152 caninclude one or more light sources and additional lighting components,such as a fill lighting system. A variety of different light sources canbe used, such as incandescent, fluorescent, high-intensity discharge,and light emitting diode light sources. The controller 140 operates tocontrol the flashing of the main light 152 during thesubject-illuminated image capture.

The subject lighting system can include one or more stands to supportand elevate the light sources of the main light 152. In addition, thesubject lighting system can include one or more light modifiers, such asan umbrella or soft box, which diffuses the light from the light sourcesof the main light 152 to provide the desired lighting pattern anddistribution.

FIG. 3 illustrates an example side perspective of the camera 104 and thefiducial marking device 106 having at least one fiducial light source160. The camera 104 and the fiducial marking device 106 can becomponents of the example photography station 102 shown and describedwith reference to FIG. 2. The fiducial light source 160 emits collimatedlight 162 to form a fiducial marker 164 on the subject S duringfiducially marked image captures by the camera 104, where a fiduciallymarked image capture can be one type of image capture in an imagecapture sequence described in detail below with reference to FIG. 11.

The fiducial light source 160 can include a laser, a light emittingdiode, a halogen light source, a fluorescent light source, or othersimilar light source operable to transmit the collimated light 162,where a color of the collimated light 162 can be selectable. A circuitof the fiducial marking device 106 can drive the emission of thecollimated light 162. The fiducial marking device 106 is in wired orwireless communication with the controller 140. In some examples, thecontroller 140 communicates directly with the circuit to synchronize theemission with the fiducially marked image capture performed by thecamera 104.

The fiducial light source 160 can be mounted or otherwise positioned onthe fiducial marking device 106 such that the collimated light 162 isemitted at a first calibrated height 168 relative to a surface 174(e.g., a floor) on which the subject S is standing on. A position of thefiducial light source 160 can be automatically or manually adjustedalong the fiducial marking device 106 such that the collimated light 162is emitted at a different calibrated height, such as a second calibratedheight 170 and a third calibrated height 172. The second calibratedheight 170 and the third calibrated height 172 are also relative to thesurface 174 on which the subject S is standing on. As one example, theposition of the fiducial light source 160 can be adjusted based on aheight of the subject S. For example, the position of the fiducial lightsource 160 can be adjusted based on the height of the subject S suchthat, when activated, the collimated light 162 emitted from the fiduciallight source 160 forms the fiducial marker 164 on the subject S. In someexamples, it can be desirable for the calibrated height to correspond toa particular portion of the subject S, where the particular portion canbe based on a length of image being captured (e.g., a full body lengthimage, a three-quarter body length image, or a head and shoulder image).

In some examples, if the fiducial marking device 106 has more than onefiducial light source, each fiducial light source can be mounted orotherwise positioned along the fiducial marking device such that therespective collimated lights are emitted at different calibratedheights. For example, three fiducial light sources can be arranged in alinear array along the fiducial marking device 106 such that therespective collimated lights are emitted at the first calibrated height168, the second calibrated height 170, and the third calibrated height172, respectively. A fiducial light source to be activated can beselected based on the height of the subject S. For example, for a talladult, the fiducial light source 160 mounted or otherwise positionedsuch that the collimated light 162 is emitted at the first calibratedheight 168 can be selected.

In some examples, a full length image of the subject S that includes thesurface 174 on which the subject S is standing can be captured with thecamera 104 for at least the fiducially marked image capture. Bycapturing the full length image when the collimated light 162 is beingemitted from the fiducial light source 160, the fiducially marked imagecan include the fiducial marker 164 formed by the collimated light 162and the surface 174.

Once the fiducially marked image is captured by the camera 104, alocation of the fiducial marker 164 can be determined. For example, atleast a vertical pixel location of the fiducial marker 164 isdetermined, as described in more detail with reference to FIG. 13. Basedon the location of the fiducial marker 164, two unique values can bedetermined that affect how a subject-illuminated image of the subject Scaptured independently from the fiducially marked image is scaled and/orresized to generate a photography product of the subject S for inclusionwith the composite group image 118, among other examples.

The two unique values can include a pixel density and a reference heightof the subject. The first calibrated height 168 is known, which is thevertical distance in inches, for example, from the surface 174 to avertical location from which the collimated light 162 is emitted fromthe light source 160. A vertical distance in pixels between a verticalpixel location of the surface 174 and a vertical pixel location of thefiducial marker 164 can be determined from the fiducially marked image.Therefore, the pixel density, which is a number of pixels in an imageper inch (or other similar measure of distance, such as centimeters,millimeters, etc.), can be determined by dividing the vertical distancein pixels by the known calibrated height. The reference height of theindividual subject can be the vertical pixel location of the fiducialmarker 164 in the image.

FIG. 4 illustrates an example side perspective of the camera 104 and thefiducial marking device 106 having at least two fiducial light sources.The camera 104 and the fiducial marking device 106 can be components ofthe example photography station 102 shown and described with referenceto FIG. 2. As illustrated, the fiducial marking device 106 includes afirst fiducial light source 180 and a second fiducial light source 182that are arranged substantially parallel to one another. The firstfiducial light source 180 emits a first collimated light 184 and thesecond fiducial light source 182 emits a second collimated light 186during fiducially marked image captures. A fiducially marked imagecapture can be one type of image capture in an image capture sequencedescribed in detail below with reference to FIG. 11.

Due to the parallel arrangement of the first fiducial light source 180and the second fiducial light source 182, a distance of the subject fromthe fiducial marking device 106 can be variable and does not affect theformation of fiducial markers within the fiducially marked imagescaptured by the camera 104. However, if a different photography station102 is used to capture one or more of the subjects, the first fiduciallight source 180 and the second fiducial light source 182 should bepositioned at a same height within the fiducial marking device 106 ineach photography station 102. Alternatively, if the first fiducial lightsource 180 and the second fiducial light source 182 are positioned atdifferent heights among the fiducial marking devices 106 of thedifferent photography stations 102, at least calibration informationneeds to be gathered and stored. Calibration information is gathered byphotographing an object of known height, such as a ruler, and performinga calibration using the image of the object of known height.

The first fiducial light source 180 and the second fiducial light source182 can include a laser, a light emitting diode, a halogen light source,a fluorescent light source, or other similar light source operable totransmit collimated light. A color of collimated light emitted by thefirst fiducial light source 180 and the second fiducial light source 182can be selectable, where the collimated light emitted by one fiduciallight source can be a same color or a different color as the collimatedlight emitted by another fiducial light source. Example colors caninclude red, blue, green or white. In some examples, the color can beselected or adjusted based on a color of clothing worn by the subject S.For example, a color that provides better signal-to-noise ratio can beselected.

Emission of the first collimated light 184 and the second collimatedlight 186 forms a first fiducial marker 188 and a second fiducial marker190 on the subject S, respectively, that are captured in the fiduciallymarked image. In some examples, the first collimated light 184 and thesecond collimated light 186 are emitted for about 16 milliseconds orless. Therefore, due to the brief emission duration, the subject S willnot notice the first collimated light and the second collimated light186.

A circuit of the fiducial marking device 106 can drive the emission ofthe first collimated light 184 and the second collimated light 186. Thefiducial marking device 106 is in wired or wireless communication withthe controller 140. In some examples, the controller 140 communicatesdirectly with the circuit to synchronize the emission with thefiducially marked image capture performed by the camera 104.

The fiducial marking device 106 can include one or more stands 192 tosupport and arrange the first fiducial light source 180 and the secondfiducial light source 182 substantially parallel to on another.Additionally, in some examples, the first fiducial light source 180 andthe second fiducial light source 182 are each positioned such that thefirst collimated light 184 and the second collimated light 186 both fallbelow the subject's head. In one example, the first fiducial lightsource 180 is positioned such that the first collimated light 184 isemitted at a vertical location 194 that is forty-seven inches above thefloor and the second fiducial light source 182 is positioned such thatthe second collimated light 186 is emitted at a vertical location 196that is forty inches above the floor. Resultantly, a vertical distance198 between the first collimated light 184 and the second collimatedlight 186 is seven inches.

The position of the first fiducial light source 180 and the secondfiducial light source 182 can be adjusted within the fiducial markingdevice 106 to account for a wide range of subject heights. In someexamples, the adjustment can be performed manually. In other examples,the adjustment can be performed automatically by an adjustment mechanismwithin the fiducial marking device 106. For example, the adjustmentmechanism can identify clothing of an upper body of the subject S andadjust the position of the first fiducial light source 180 and/or thesecond fiducial light source 182 accordingly. Additionally, the fiducialmarking device 106 can have a third fiducial light source to facilitatethe wider range of subject heights.

In some examples, the fiducial marking device 106 is positionedseparately from the camera 104, and thus is not on a same optical axisof the camera 104. As a result, in some cases, the reflection of thefirst collimated light 184 and/or the second collimated light 186 off ofthe subject S (e.g., the first fiducial marker 188 and/or the secondfiducial marker 190 formed) can be covered by the subject S as viewed bythe camera 104. For example, a marker could fall just under a chin ofthe subject S or a marker could be lost inside a shirt of the subject S.In some examples, if the first fiducial marker 188 and/or the secondfiducial marker 190 are not captured in the fiducially marked image, analert can be generated. The alert can be provided to the photographerthrough the camera 104 or the remote computing device 154, for example,to notify the photographer. In some examples, the alert can prompt thephotographer to re-initiate the image capture sequence.

Although two fiducial light sources are shown and described in FIG. 4,in other examples, the fiducial marking device 106 can have only asingle fiducial light source that emits a single collimated light asshown and described in FIG. 3. Additionally, the fiducial marking device106 can be have single fiducial light source along with a beam splitteror diffractive optical element. The beam splitter or diffractive opticalelement operate to separate a single collimated light emitted from thesingle fiducial light source into the first collimated light 184 and thesecond collimated light 186 that form the first fiducial marker 188 andthe second fiducial marker 190 on the subject S, respectively, duringthe fiducially marked image capture. In further examples, the fiducialmarking device 106 can have one or more additional fiducial lightsources (e.g., three or more fiducial light sources) that operate toemit collimated light to form three or more fiducial markers on thesubject S in a linear array or in a grid pattern, for example, duringthe fiducially marked image capture. In yet further examples, a lens canbe placed in front of the collimated light to create a line ofcollimated light at the subject. This can facilitate visibility of thefiducial marker on the subject formed from the collimated light (e.g.,prevent cases where a fiducial marker is buried inside the subject'sclothing rendering it invisible in the fiducially marked image).

Once a fiducially marked image is captured by the camera 104, a locationof the first fiducial marker 188 and a location of the second fiducialmarker 190 in the fiducially marked image can be determined. Forexample, a vertical pixel location and a horizontal pixel location ofthe first fiducial marker 188 and a vertical pixel location and ahorizontal pixel location of the second fiducial marker 190 aredetermined, as described in more detail with reference to FIG. 13. Basedon the location of the first fiducial marker 188 and the second fiducialmarker 190, two unique values can be determined that affect how asubject-illuminated image of the subject is scaled and/or resized togenerate a photography product for inclusion with the composite groupimage 118, among other examples. The two unique values include a pixeldensity and a reference height of the subject.

If the subject is two dimensional (e.g., an object having only a heightand a length), the first fiducial marker 188 and the second fiducialmarker 190 would be at a same horizontal pixel location and each have aknown vertical location corresponding to the vertical location 194 andvertical location 176. However, most subjects are three-dimensional,therefore a compensation for how the first collimated light 184 and thesecond collimated light 186 reflect off of the subject is needed toaccount for the three-dimensional effect when determining the pixeldensity and the reference height.

In some examples, the compensation is based on the relative horizontalpixel locations of the first fiducial marker 188 and the second fiducialmarker 190 in the fiducially marked image. For example, the compensationcan differ when the horizontal pixel location of the first fiducialmarker 188 is lesser than or equal to the horizontal pixel location ofthe second fiducial marker 190 versus when the horizontal pixel locationof the first fiducial marker 188 is greater than the horizontal pixellocation of the second fiducial marker 190. Additionally, thecompensation can be dependent on a tilt angle 199 of the camera 104. Thevalue determination and associated compensation are described in greaterdetail below with reference to FIGS. 11 and 12.

FIG. 5 is a schematic block diagram of the camera 104. The camera 104can be a mirrorless digital camera including at least an electronicimage sensor 200 for converting an optical image to an electric signal,a processor 202 for controlling the operation of the camera 104, andmemory 204 for storing the electric signal in the form of digital imagedata. A commercially available example of a mirrorless camera is theNikon 1V3 available from Nikon Corporation.

An example of electronic image sensor 200 is a charge-coupled device(CCD). Another example of electronic image sensor 200 is a complementarymetal-oxide-semiconductor (CMOS) active-pixel sensor. Electronic imagesensor 200 receives light from a subject and background and converts thereceived light into electrical signals. The signals are converted into avoltage, which is then sampled, digitized, and stored as digital imagedata in the memory 204.

The memory 204 can include various different forms of computer readablestorage media, such as random access memory. In some examples, thememory 204 includes a memory card. A wide variety of memory cards areavailable for use in various embodiments. Examples include: aCompactFlash (CF) memory card (including type I or type II), a SecureDigital (SD) memory card, a mini Secure Digital (mini SD) memory card, amicro Secure Digital (microSD) memory card, a smart media (SM/SMC) card,a Multimedia Card (MMC), an xD-Picture Card (xD), a memory stick (MS)including any of the variations of memory sticks, an NT card, and a USBmemory stick (such as a flash-type memory stick). Other embodimentsinclude other types of memory, such as those described herein, or yetother types of memory.

A lens 206 is located in front of a shutter 208 and is selected toprovide the appropriate photographic characteristics of lighttransmission, depth of focus, etc. The shutter 208 can be mechanical,electrical, or both. In some embodiments, the lens 206 is selectedbetween 50 and 250 mm, with the image taken at an f-stop generally inthe range of f16 to f22; in the range of f4 to f16; or in the range off4 to f22. This provides a zone focus for the image. It also generallyeliminates concerns regarding ambient light. However, it will beappreciated that any number of lenses, focusing, and f-stops may beemployed in connection with the present invention.

To initiate an image capture sequence, an image capture button on theremote control device 142 is preferably used. In some examples, theremote control device 142 is connected to the controller 140, whichgenerates a shutter release signal that is communicated to a shuttercontroller 210 of the camera 104. However, other methods and devices canbe used to initiate the image capture. For example, a button, switch orother device might be included on the controller 140 or connected to thecamera 104. Still further, a computing device, such as the remotecomputing device 154 or the image processing system 110, is used in someembodiments to initiate the process.

A zoom controller 212 is also provided in some examples to mechanicallyadjust the lens 206 to cause the camera 104 to zoom in and out on asubject. The remote control device 142 can include zoom in and outbuttons, and signals from the remote control device 142 are communicatedto the controller 140, which communicates the request to the zoomcontroller 212. In some examples, the zoom controller 212 includes amotor that adjusts lens 206 accordingly.

The camera 104 can further include a video camera interface 214 and adata interface 216. The video camera interface 214 can communicate livevideo data from the camera 104 to the controller 140 (or computingdevice 340) in some embodiments. In some embodiments, the video camerainterface 214 communicates live video data from the camera 104 to theremote computing device 154 or a digital display on the camera 104.

The data interface 216 is a data communication interface that sends andreceives digital data to communicate with another device, such ascontroller 140 or the image processing system 110. For example, the datainterface 216 can receive image capture messages from the controller 140that instruct the camera 104 to capture one or more digital images. Thedata interface 216 can also transfer captured digital images, such asthe images of the individual subjects 108 from the memory 204 to anotherdevice, such as the controller 140 or the image processing system 110.Examples of the video camera interface 214 and the data interface 216include USB interfaces. In some examples, the video camera interface 214and the data interface 216 are a same interface, while in otherexamples, they are separate interfaces.

FIG. 6 is a schematic block diagram of the fiducial marking device 106.The fiducial marking device 106 includes fiducial light sources 180,182, and 230, a circuit 232, and a controller interface 234.

The fiducial light sources 180, 182, and 230 can include lasers, lightemitting diodes, halogen light sources, fluorescent light sources, orother similar light sources operable to transmit collimated light. Acolor of the collimated light emitted by the fiducial light sources 180,182, and 230 can be selectable, where the collimated light emitted byone fiducial light source can be a same color or a different color asthe collimated light emitted by another fiducial light source. In someexamples, the color can be selected or adjusted based on a color ofclothing worn by a subject. For example, a color that provides bettersignal-to-noise ratio can be selected. The color can be red, blue, greenor white.

In some examples, the fiducial marking device 106 includes the firstfiducial light source 180 and the second fiducial light source 182, asshown and described in FIG. 4. The first fiducial light source 180 emitsthe first collimated light 184 and the second fiducial light source 182emits the second collimated light 186. Emission of the first collimatedlight 184 and the second collimated light 186 forms a first fiducialmarker 188 and a second fiducial marker 190 on the subject. The firstfiducial light source 180 and the second fiducial light source 182 canbe arranged substantially parallel to one another such that the emittedfirst collimated light 184 and the second collimated light 186 form thefirst fiducial marker 188 substantially parallel to the second fiducialmarker 190 on the subject S. In some examples, the first fiducial lightsource 180 and the second fiducial light source 182 are positioned suchthat the first fiducial marker 188 and the second fiducial marker 190are arranged vertically, horizontally, or diagonally to one another.

In other examples, in addition to the first fiducial light source 180and the second fiducial light source 182, the fiducial marking device106 includes one or more additional fiducial light sources up to anN^(th) fiducial light source 230. The additional fiducial light sourcescan continue to be arranged substantially parallel to one another suchthat the emitted collimated light forms a linear array of fiducialmarkers on the subject S during the fiducially marked image captures. Inother examples, the additional fiducial light sources can be arrangedsuch that the emitted collimated light forms a grid pattern of fiducialmarkers on the subject S during the fiducially marked image captures.

In further examples, the fiducial marking device 106 can have only asingle fiducial light source, such as the first fiducial light source180, along with a beam splitter or diffractive optical element to splita single emitted collimated light into the first collimated light 184and the second collimated light 186 to form the first fiducial marker188 and the second fiducial marker 190 on the subject S during thefiducially marked image captures. Alternatively, the fiducial markingdevice 106 can have a single fiducial light source that emits a singlecollimated light, similar to the fiducial light source 160 shown anddescribed with reference to FIG. 3.

The circuit 232 of the fiducial marking device 106 can drive theemission of the collimated light from the fiducial light sources 180,182, and 230. In some examples, the circuit 232 is integrated with thefiducial marking device 106 as illustrated. In other examples, thecircuit 232 is a separate device from the fiducial marking device 106.The circuit 232 is shown and described in greater detail below withreference to FIG. 7.

The fiducial marking device 106 is in wired or wireless communicationwith the controller 140 via the controller interface 234. In someexamples, the controller 140 communicates directly with the circuit 232to synchronize the emission of the collimated light with the fiduciallymarked image capture of an image capture sequence performed by thecamera 104.

FIG. 7 is an example of the circuit 232 previously discussed withreference to FIG. 6. The circuit 232 can include switch circuitry 240and drive circuitry 242. The switch circuitry 240 can include an input244, capacitors 246, and an operational amplifier 248, among othercircuitry. The drive circuitry 242 can include a transistor 250 coupledto the first fiducial light source 180 and the second fiducial lightsource 182, a combination element 252 that includes a resistor 254 and acapacitor 256, and an output 258, among other circuitry.

In some examples, the capacitors 246 and the operational amplifier 248of the switch circuitry 240 work in combination to control a time periodduring which the transistor 250 of the drive circuitry 242 remains on.As one example, a signal can be received via the input 244 that causesthe switch circuitry 240 to switch on the transistor 250. When switchedon, the transistor 250 drives (e.g., powers on) the first fiducial lightsource 180 and the second fiducial light source 182 to emit collimatedlight. In some examples, the signal is received in response to anillumination or flash of the background lights (shown in FIG. 2) suchthat the collimated light is emitted synchronously with the backgroundlights 144. The transistor 250 remains on for the time period controlledby the switch circuitry 240. For example, the time period is associatedwith a first time period. Once the first time period lapses, the switchcircuitry 240 switches off the transistor 250, which causes the firstfiducial light source 180 and the second fiducial light source 182 topower off and cease emitting the collimated light.

The combination element 252 at the output 258 of the drive circuitry 242that includes the resistor 254 and the capacitor 256 provides a backupmechanism to power off the first fiducial light source 180 and thesecond fiducial light source 182 in case a component in the switchcircuitry 240 of the circuit 232 fails causing the transistor 250 of thecircuit to remain on. For example, if the transistor 250 remains on pasta predetermined time period, the combination element 252 powers off thefirst fiducial light source 180 and the second fiducial light source 182to cease the emission of collimated light. In some examples, thepredetermined time period is a second time period that is longer thanthe first time period. As one example, the second time period is aroundabout 50 milliseconds.

FIG. 8 is a schematic block diagram of the controller 140 of thephotography station 102. In this example, the controller 140 includes aprocessor 300, a memory 302, and a light control interface 304 includinga main light interface 306, a background light interface 308 and afiducial marking device interface 310 that can include a circuitinterface 312. The controller 140 also includes a computer datainterface 314, an input/output interface 316, a camera interface 318including a data interface 320 and a video interface 322, and a powersupply 324.

The processor 300 can perform control operations of the controller 140,and interfaces with the memory 302. Examples of suitable processors andmemory are described herein.

The light control interface 304 allows the controller 140 to control theoperation of one or more lights of the photography station 102. Forexample, the main light interface 306 allows the controller 140 tocontrol the operation of the main light 152 of the subject lightingsystem. The background light interface 308 allows the controller 140 tocontrol the operation of the background lights 144 of the backgroundlighting system. The fiducial marking device interface 310 allows thecontroller 140 to control the operation of the fiducial light sources ofthe fiducial marking device 106, including the first fiducial lightsource 180 and the second fiducial light source 182. In some examples,the fiducial marking device interface 310 includes the circuit interfaceto allow the controller 140 to directly drive the circuit 232 of thefiducial marking device 106.

The connection between the controller 140 and the various lightingsystems and devices is wired and/or wireless. In some examples, thelight control interface 304 is a send only interface that does notreceive return communications from the lighting systems and devices.Other examples permit bidirectional communication. The light controlinterface 304 is operable to selectively illuminate one or more lightsat a given time. The controller 140 operates to synchronize theillumination of the lights with the operation of camera 104. Forexample, the illumination of the lights can be synchronized with animage capture sequence of the camera 104. In some examples, thecontroller 140 provides one or more triggers or pulses to the backgroundlights 144, the main light 152, and the one or more fiducial lightsources of the fiducial marking device 106. In other examples, thecontroller 140 communicates digital messages that are used tosynchronize and control the various operations.

The computer data interface 314 allows the controller 140 to send andreceive digital data with a computing device (e.g., computing device 340described in FIG. 9). An example of the computer data interface 314 is auniversal serial bus interface, although other communication interfacesare used in other embodiments, such as a wireless or serial businterface.

One or more input devices, such as the remote control device 142, arecoupled to the processor 300 through input/output interface 316. Theinput devices can be connected by any number of input/output interfaces316 in various embodiments, such as a parallel port, serial port, gameport, universal serial bus, or wireless interface.

The camera interface 318 allows the controller 140 to communicate withthe camera 104. In some embodiments, camera interface 318 includes thedata interface 320 that communicates with data interface 216 of thecamera 104 (shown in FIG. 5), and a video interface 322 thatcommunicates with video camera interface 214 of the camera 104 (alsoshown in FIG. 5). Examples of such interfaces include universal serialbus interfaces. Other embodiments include other interfaces.

In some examples, a power supply 324 is provided to receive power, suchas through a power cord, and to distribute the power to other componentsof the photography station 102, such as through one or more additionalpower cords. Other embodiments include one or more batteries. Further,in some examples, the controller 140 receives power from another device.

The controller 140 is arranged and configured to synchronize theillumination of background lights 144, the main light 152, and thefiducial light sources with the image captures, either through wired orwireless communication. In some examples, the controller 140 providesone or more triggers or pulses to the background lights 144, the mainlight 152, and the fiducial light sources. In other examples, thecontroller 140 communicates digital messages that are used tosynchronize and control the various operations.

FIG. 9 is a schematic block diagram illustrating an architecture of acomputing device that can be used to implement aspects of the presentdisclosure, including the camera 104, the image processing system 110,and the remote computing device 154, and will be referred to herein asthe computing device 340.

The computing device 340 is used to execute the operating system,application programs, and software modules (including the softwareengines) described herein.

The computing device 340 includes, in some embodiments, at least oneprocessing device 342, such as a central processing unit (CPU). Avariety of processing devices are available from a variety ofmanufacturers, for example, Intel or Advanced Micro Devices. In thisexample, the computing device 340 also includes a system memory 344, anda system bus 346 that couples various system components including thesystem memory 344 to the processing device 342. The system bus 346 isone of any number of types of bus structures including a memory bus, ormemory controller; a peripheral bus; and a local bus using any of avariety of bus architectures.

Examples of computing devices suitable for the computing device 340include a desktop computer, a laptop computer, a tablet computer, amobile device (such as a smart phone, an iPod® mobile digital device, orother mobile devices), or other devices configured to process digitalinstructions.

The system memory 344 includes read only memory 348 and random accessmemory 350. A basic input/output system 352 containing the basicroutines that act to transfer information within the computing device340, such as during start up, is typically stored in the read onlymemory 348.

The computing device 340 also includes a secondary storage device 354 insome embodiments, such as a hard disk drive, for storing digital data.The secondary storage device 354 is connected to the system bus 346 by asecondary storage interface 356. The secondary storage devices and theirassociated computer readable media provide nonvolatile storage ofcomputer readable instructions (including application programs andprogram modules), data structures, and other data for the computingdevice 340.

Although the exemplary environment described herein employs a hard diskdrive as a secondary storage device, other types of computer readablestorage media are used in other embodiments. Examples of these othertypes of computer readable storage media include magnetic cassettes,flash memory cards, digital video disks, Bernoulli cartridges, compactdisc read only memories, digital versatile disk read only memories,random access memories, or read only memories. Some embodiments includenon-transitory media.

A number of program modules can be stored in the secondary storagedevice 354 or the memory 344, including an operating system 358, one ormore application programs 360, other program modules 362, and programdata 364.

In some embodiments, the computing device 340 includes input devices toenable a user to provide inputs to the computing device 340. Examples ofinput devices 366 include a keyboard 368, a pointer input device such asa mouse 370, a microphone 372, and a touch sensitive display 374. Otherembodiments include other input devices 366. The input devices are oftenconnected to the processing device 342 through an input/output interface376 that is coupled to the system bus 346. These input devices 366 canbe connected by any number of input/output interfaces, such as aparallel port, serial port, game port, or a universal serial bus.Wireless communication between input devices and interface 376 ispossible as well, and includes infrared, Bluetooth® wireless technology,802.11a/b/g/n, cellular, or other radio frequency communication systemsin some possible embodiments.

In this example embodiment, a touch sensitive display device 378 is alsoconnected to the system bus 346 via an interface, such as a videoadapter 380. The touch sensitive display device 378 includes touchsensors for receiving input from a user when the user touches thedisplay. Such sensors can be capacitive sensors, pressure sensors, orother touch sensors. The sensors not only detect contact with thedisplay, but also the location of the contact and movement of thecontact over time. For example, a user can move a finger or stylusacross the screen to provide written inputs. The written inputs areevaluated and, in some embodiments, converted into text inputs.

In addition to the display device 378, the computing device 340 caninclude various other peripheral devices (not shown), such as speakersor a printer.

When used in a local area networking environment or a wide areanetworking environment (such as the Internet), the computing device 340is typically connected to the network 382 through a network interface,such as a wireless network interface 384. Other possible embodiments useother communication devices. For example, some embodiments of thecomputing device 340 include an Ethernet network interface, or a modemfor communicating across the network.

In some examples, the computing device 340 includes a power supply thatprovides electric power to several components and elements of thecomputing device 340. Examples of the power supply include AC powersupplies, DC power supplies, and batteries, either disposable orrechargeable.

The computing device 340 typically includes at least some form ofcomputer-readable media. Computer readable media includes any availablemedia that can be accessed by the computing device 340. By way ofexample, computer-readable media include computer readable storage mediaand computer readable communication media.

Computer readable storage media includes volatile and nonvolatile,removable and non-removable media implemented in any device configuredto store information such as computer readable instructions, datastructures, program modules or other data. Computer readable storagemedia includes, but is not limited to, random access memory, read onlymemory, electrically erasable programmable read only memory, flashmemory or other memory technology, compact disc read only memory,digital versatile disks or other optical storage, magnetic cassettes,magnetic tape, magnetic disk storage or other magnetic storage devices,or any other medium that can be used to store the desired informationand that can be accessed by the computing device 340.

Computer readable communication media typically embodies computerreadable instructions, data structures, program modules or other data ina modulated data signal such as a carrier wave or other transportmechanism and includes any information delivery media. The term“modulated data signal” refers to a signal that has one or more of itscharacteristics set or changed in such a manner as to encode informationin the signal. By way of example, computer readable communication mediaincludes wired media such as a wired network or direct-wired connection,and wireless media such as acoustic, radio frequency, infrared, andother wireless media. Combinations of any of the above are also includedwithin the scope of computer readable media.

FIG. 10 illustrates example composition rules for capturing a digitalimage of the subject S. Prior to capturing a digital image of thesubject S, a display 400 that includes visual indicators correspondingto image composition rules is provided to aid a photographer in aligningthe subject and adjusting the camera (e.g., zooming, focusing, etc.).The display 400 can be provided by a display of the camera 104 and/or adisplay of the remote computing device 154.

In some examples, the visual indicators include a first set of lines 402at a top of the display 400 and a second set of lines 404 at a bottom ofthe display 400. The first set of lines 402 can correspond to acomposition rule for positioning a top of the subject's head. Forexample, the top of the head should be positioned below a top line 406of the first set of lines 402 and above a bottom line 408 of the firstset of lines 402. The second set of lines 404 can correspond to acomposition rule for positioning the subject's hands. For example, thehands should fall above a bottom line 410 of the second set of lines 404and below a top line 412 of the second set of lines 404. Differentcomposition rules can apply to different poses of the subject. A pose isa particular positioning, movement or angle of the subject. For example,poses can include standing, sitting, jumping, among others. Asillustrated the first set of lines 402 and the second set of lines 404can apply to a standing pose of the subject, where an image includingthe subject's head and shoulders is desired, for example. Additionally,even for a same pose, the composition rules can vary, if one or more ofthe individual subjects' stature is affected by a disability, forexample.

Once the subject S is aligned in accordance with the composition rules,the photographer can initiate an image capture sequence (e.g., bypushing a button on the remote control device 142). The display 400 canbe provided in between each image capture sequence to ensure compliancewith the composition rules. This can be especially important if the poseof the subject changes between image capture sequences (e.g., if thesubject goes from standing to sitting).

FIG. 11 illustrates example image capture sequences 420A, 420B, 420Cperformed by the camera 104. In some examples, more than one variationof the image capture sequence can be performed. In some examples, theimage capture sequence includes at least three images captured such asimage capture sequence 420A and 420B. In other examples, the imagecapture sequence includes only two images captured such as image capturesequence 420C.

In the image capture sequence 420A, a first image can include abackground-illuminated image 422 that is captured while the backgroundlights 144 are illuminated. A second image can include asubject-illuminated image 424 that is captured while the main light 152is illuminated. A third image can include a fiducially marked image 426that is captured while one or more fiducial light sources of thefiducial marking device 106 are illuminated (e.g., while the one or morecollimated are being emitted). In image capture sequence 420A, no otherexposures are present in the third image. For example, no other lights,such as the background lights 144 are being illuminated while thefiducial light sources are illuminated.

In the image capture sequence 420B, a first image can include thebackground-illuminated image 422 that is captured while the backgroundlights 144 are illuminated. A second image can include thesubject-illuminated image 424 that is captured while the main light 152is illuminated. A third image can include a single image frame 428 thatis effectively a combination of the background-illuminated image 422 andthe fiducially marked image 426 captured in a single frame. For example,during the capture of the third image both the background lights 144 andthe fiducial light sources are illuminated.

In the image capture sequence 420C, the first image can include thesingle image frame 428 captured while both the background lights 144 andthe fiducial light sources are illuminated. The second image can includethe subject-illuminated image 424 captured while the main light 152 isilluminated.

In each of the described image capture sequences, 420A, 420B, and 420C,the subject-illuminated image is captured while the main light 152 isilluminated independent from any other image and illumination. Thecontroller 140 can operate to synchronize the illumination of thevarious light sources with the respective image captures.

FIG. 12 is a system flow diagram for assembling the composite groupimage 118 from images of individual subjects 108. The system 100includes the photography station 102 and the image processing system 110as described in FIG. 1. The camera 104 of the photography station 102can perform an image capture sequence, such as one of the image capturesequences 420A, 420B, and 420C described in FIG. 11. In one of the imagecaptures, the fiducial marking device 106 of the photography station 102is activated. For example, referencing the fiducial marking device 106shown and described in FIG. 4, the first fiducial light source 180 andthe second fiducial light source 182 are activated by the circuit 232 toemit the first collimated light 184 and the second collimated light 186forming the first fiducial marker 188 and the second fiducial marker 190on the subject S, which is captured in the fiducially marked image 426or the single image frame 428. Other images captured by the camera 104can include a background-illuminated image 422 and thesubject-illuminated image 424. Similar images can be captured for eachsubject to be included within the composite group image 118.

Once captured by the camera 104, a set of images for each of thesubjects of the group (e.g., collectively referred to as the images ofindividual subjects 108) can be transmitted from the camera 104 to theimage processing system 110. In one example, a set of images can includethe background-illuminated image 422, the subject-illuminated image 424,and the fiducially marked image 426. As another alternative, the set ofimages can include the background-illuminated image 422, thesubject-illuminated image 424, and the single image frame 428. As afurther alternative, the set of images can include thesubject-illuminated image 424 and the single image frame 428.

In addition to the fiducial marker analyzer 114 and the composite groupimage assembler 116 described in FIG. 1, the composite group imagegenerator 112 can further include a mask generator 430 and a maskapplicator 432. The mask generator 430 can receive thebackground-illuminated image 422 and/or the single image frame 428 togenerate a mask 434.

In some examples, the mask generator 430 can generate the mask 434 usinga single image. In one example, the mask 434 can be generated using thebackground-illuminated image 422 if the image capture sequence 420A or420B is performed. In another example, the mask 434 can be generatedusing the single image frame 428 if the image capture sequence 420C isperformed. Additional details for generating the mask 434 based on asingle image are described in U.S. Pat. No. 7,834,894, issued on Nov.16, 2010, entitled METHOD AND APPARATUS FOR BACKGROUND REPLACEMENT INSTILL PHOTOGRAPHS, the entirety of which is hereby incorporated byreference.

In other examples, the mask generator 430 can generate a mask frommultiple images. For example, if the image capture sequence 420B isperformed where the background lights 144 are illuminated in both thefirst and third capture, the mask generator 430 can generate the mask434 using both the background-illuminated image 422 and the single imageframe 428. By generating the mask 434 using both thebackground-illuminated image 422 and the single image frame 428, anymotion of the subject S between the first capture and the third capturecan be determined and an intermediate position of the subject during thesecond capture (e.g., the capture of the subject-illuminated image 424)is estimated. The mask 434 can then be generated at the estimatedintermediate position. In some examples, the subject-illuminated image424 can also be utilized to facilitate generation of the mask 434.Additional details for generating the mask 434 based on multiple imagesare described in U.S. Pat. No. 10,110,792, issued on Oct. 23, 2018,entitled BACKGROUND REPLACEMENT SYSTEM AND METHODS, the entirety ofwhich is hereby incorporated by reference.

After the mask 434 is generated, the mask applicator 432 can receive themask 434 along with the subject-illuminated image 424. The maskapplicator 432 can then overlay the mask 434 onto thesubject-illuminated image 424. The mask 434 should have equal to, orclose to, a 1-to-1 correspondence in position with the subject S in thesubject-illuminated image 424. For example, the mask 434 has the samewidth and height dimensions in pixels as the subject-illuminated image424. Thus, in one embodiment, one corner pixel of the mask 434 can bealigned with the corresponding corner pixel of the subject-illuminatedimage 424. Then any portion of the subject-illuminated image 424 that isnot covered by the mask 434 (e.g., the background) can be removed suchthat only the subject S remains, hereinafter referred to as an extractedsubject image 436. In some examples, a new subject image is created fromthe subject-illuminated image 424 and the mask 434 is overlaid onto thenew subject image to generate the extracted subject image 436. Theextracted subject image 436 and the mask 434 for each subject to beincluded in the composite group image 118 can be provided to thecomposite group image assembler 116.

Additionally, for each subject's set of images, the fiducial markeranalyzer 114 can determine a pixel density 438 of the images and areference height 440 of the subject based on a location of the firstfiducial marker 188 and the second fiducial marker 190. As described ingreater detail below with reference to FIG. 13, to determine thefiducial marker locations, a new image can be created, where a value foreach pixel in the new image is set to a first value or a second valuebased on a set of conditions. The set of conditions are associated withvalues of the pixel in one or more images captured in the image capturesequence 420, including the background-illuminated image 422, thesubject-illuminated image 424, the fiducially marked image 426 and/orthe single image frame 428, for example. In some examples, a pixel beingset to the first value can indicate the pixel is in a location where thefirst collimated light 184 or the second collimated light 186 formed thefirst fiducial marker 188 or the second fiducial marker 190 on thesubject S. The pixel being set to the first value indicates the pixel isnot in a location where the first collimated light 184 or the secondcollimated light 186 formed the first fiducial marker 188 or the secondfiducial marker 190 on the subject S.

Once a value for each pixel is determined, pixels having the first valuethat are otherwise surrounded by pixels having the second value can beidentified and the value of those pixels reset to the second value(e.g., to effectively remove these outlier pixels from the clusteridentification). Clusters can then be identified from remaining pixelshaving the first value. For example, a first cluster of pixelsidentified can correspond to the first fiducial marker 188 and a secondcluster of pixels identified can correspond to the second fiducialmarker 190. A first horizontal pixel location and a first vertical pixellocation at a center of the first cluster can be determined as thelocation of the first fiducial marker 188. A second horizontal pixellocation and a second vertical pixel location at a center of the secondcluster can be determined as the location of the second fiducial marker190.

Based on the location of the first fiducial marker 188 and the locationof the second fiducial marker 190, the pixel density 438 and thereference height 440 of the subject can be determined. In some examples,the determination is further based on the first horizontal pixellocation relative to the second horizontal pixel location. For example,when the first horizontal pixel location is less than or equal to thesecond horizontal pixel location, the reference height 440 of thesubject can be determined based on the first vertical pixel location,the first horizontal pixel location, the second horizontal pixellocation, and the tilt angle 199 of the camera 104. Alternatively, whenthe first horizontal pixel location is greater than the secondhorizontal pixel location, the reference height 440 of the subject isdetermined to be the first vertical pixel location. The determination ofthe pixel density 438 is based on the first and second horizontal pixellocations, the first and second vertical pixel locations, a coefficientdependent on the first horizontal pixel location relative to the secondhorizontal pixel location and the vertical distance 198 between thefirst collimated light 184 and the second collimated light 186. Oncedetermined, the pixel density 438 and the reference height 440 of thesubject can then be transmitted to the composite group image assembler116.

The composite group image assembler 116 can include one or more of ascaler 442, an arranger 444, a background applicator 446, and an editor448. For each subject to be included in the composite group image 118,the composite group image assembler 116 can receive and use the mask434, the extracted subject image 436, the pixel density 438, and thereference height 440 of the subject to generate a photography product ofthe subject (e.g., by processing at least the extracted subject image436 and optionally the mask 434 based on the pixel density 438 and thereference height 440 of the subject) for inclusion in the compositegroup image 118.

As part of the processing, the scaler 442 can process the extractedsubject image 436 based on several factors to create a scaled subjectimage 450. For example, the scaler 442 can process the extracted subjectimage 436 based on the determined pixel density 438 and the referenceheight 440 of the subject relative to determined pixel densities ofimages captured of the other subjects and reference heights of the othersubjects to be included in the composite group image 118. Thisprocessing enables subjects to be more accurately represented relativeto their heights and sizes in the composite group image 118. In additionto resizing and/or scaling the extracted subject image 436, theprocessing can include panning the extracted subject image 436 oradjusting the extracted subject image 436 vertically based on thesubject height so that the subject appears to be a proper height withinthe composite group image 118.

Additionally, the scaler 442 can process the extracted subject image 436based on a position of the subject relative to positions of the othersubjects in the composite group image 118. As one example, the compositegroup image 118 can include multiple rows of subjects, such as thecomposite group image 118 shown in FIG. 14. Taller subjects are oftenarranged (e.g., by the arranger 444) in a row toward the back, whileshorter subjects are arranged in a row toward the front. Scaling factorsfor the extracted subject image can then vary based on a row in whichthe subject is to be arranged in order to achieve a more natural look.For example, subjects in a front row may be scaled slightly larger thansubjects in a back row to simulate the effects of being closer to a lensof a camera.

In some examples, the scaler 442 can also receive the mask 434, wherethe mask 434 is scaled substantially the same as the extracted subjectimage 436. For example, a scaled mask 452 can have an equal to, or closeto, a 1-to-1 correspondence in position with the subject S in the scaledsubject image 450. This can allow for greater accuracy in backgroundinsertion and/or replacement once the subject is arranged within thecomposite group image 118.

The scaled subject image 450 of the subject S (e.g., the photographyproduct of the subject S) can then be arranged relative to scaledsubject images of the other subjects to be included in the compositegroup image 118 by the arranger 444. If a background is to be inserted,the background applicator 446 can apply the scaled mask 452 to thescaled subject image 450 for each subject, and insert the background.The scaled mask 452 can then be removed leaving the scaled subject image450 integrated with background in a natural looking manner (e.g., as ifthe subjects were standing in front of the background when the image wascaptured). In some examples, the editor 448 can perform further edits tothe composite group image 118. As one example, the composite group image118 can be cropped such that no subjects appear cut off. In furtherexamples, vignettes and shadowing can be applied to the composite groupimage 118 such that no subject appear cut off. Other transformations canalso performed by the editor 448. Examples of transformations include acolor correction, a dust correction, a brightness correction, a tilt, orother desired transformations or combinations of transformations.Additional details regarding arrangement, background insertion, andediting are disclosed in U.S. Pat. No. 9,025,906 B2 issued on May 5,2015 and U.S. patent application Ser. No. 13/804,880 filed on Mar. 24,2013, the entireties of which are hereby incorporated by reference. Thecomposite group image 118 is then provided as output of the imageprocessing system 110.

In some examples, the composite group image 118 can be provided to aproduction system to produce one or more products. Examples of productsinclude marketing or promotional material, a photo mug, a picture book,a photograph, a computer-readable medium storing digital image data, anddigital images delivered across a network. Other examples of productsinclude a composite product (composed of multiple different images), aphoto mouse pad, a collage, a key tag, a digital picture frame ordigital key chain, a photo card (such as a student identification card,driver's license, holiday or greeting card, security badge, baseball orother sports card, luggage tag, etc.), a photo magnet, an ornament, apuzzle, a calendar, a tote bag, a photo keepsake box, a t-shirt, anapron, or a variety of other products including a photographic image. Insome examples, the production system can include a web server that isconfigured to communicate data across a network, such as to sendproducts in the form of digital data to a client computing system.

FIG. 13 conceptually illustrates the fiducially marked image 426 andanalysis thereof. For example, when the image capture sequence 420A isperformed, the fiducially marked image 426 is captured by the camera 104while the first fiducial light source 180 and the second fiducial lightsource 182 of the fiducial marking device 106 shown and described withreference to FIG. 4 are emitting the first collimated light 184 and thesecond collimated light 186. The fiducially marked image 426 includesthe first fiducial marker 188 and the second fiducial marker 190 formedon the subject S by the first collimated light 184 and the secondcollimated light 186, respectively. The camera 104 can transmit imagedata, including the fiducially marked image 426, to the image processingsystem 110. The fiducial marker analyzer 114 of the composite groupimage generator 112 can then analyze the fiducially marked image 426 todetermine a location of the first fiducial marker 188 and the secondfiducial marker 190. Based on the location of the first fiducial marker188 and the second fiducial marker 190, the fiducial marker analyzer 114can further determine the pixel density 438 and the reference height 440(e.g., in pixels) of the subject S.

Determining a location of the first fiducial marker 188 and the secondfiducial marker 190 includes determination of a horizontal pixellocation and a vertical pixel location of the first fiducial marker 188and of the second fiducial marker 190. To determine the locations, a newimage 460 is generated utilizing each image captured in the imagecapture sequence 420A to identify pixels where the first collimatedlight 184 and the second collimated light 186 illuminated the subject S.The pixels can be identified based on a set of conditions that areassociated with pixel values in each image in the image capture sequence420A, including the background-illuminated image 422, thesubject-illuminated image 424, and the fiducially marked image 426.

As one example, a gray representation of the background-illuminatedimage 422 (Gray 1), a gray representation of the subject-illuminatedimage 424 (Gray 2), and a gray representation of the fiducially markedimage 426 (Gray 3) are computed. Gray 1, Gray 2, and Gray 3 are computedby obtaining a mean of the red, green, and blue pixel values of thepixel in the respective image. For example, to compute Gray 1, the redpixel value, the green pixel value and the blue pixel value of the pixelin the background-illuminated image 422 are summed and then divided bythree. Similar computations are performed for Gray 2 and Gray 3. Also, adifference in the red pixel value of the pixel in thebackground-illuminated image 422 (Red 1) and the red pixel value of thepixel in the fiducially marked image 426 (Red 3) is computed. Further, ared chromaticity value (r3) and a green chromaticity value (g3) of thepixel in the fiducially marked image 426 is computed. The pixel can beidentified as a pixel where the first collimated light 184 and thesecond collimated light 186 illuminated the subject S when each of thefollowing conditions based on the above-discussed pixel associatedvalues are satisfied: Gray1<Gray2, Gray3<Gray2, Red3−Red1>40, r3>0.50,and g3<0.30.

If the set of conditions are met, then an intensity of the pixel can beset to a first value in the new image 460 to indicate the pixel is apixel where the first collimated light 184 and the second collimatedlight 186 illuminated the subject S. For example, the first value can bea value of 255 such that the pixel appears white in the new image 460.If the set of conditions are not met, then the intensity of the pixelcan be set to a second value in the new image 460 to indicate the pixelis not a pixel where the first collimated light 184 and the secondcollimated light 186 illuminated the subject S. For example, the secondvalue can be a value of 0 such that the pixel appears black in the newimage 460.

Once each pixel in the new image 460 has been analyzed and set to thefirst value (e.g., 255) or the second value (e.g., 0), one or morepixels having the first value that are surrounded by pixels having thesecond value can be reset from the first value to the second value toeffectively remove the surrounded pixels from a subsequent clusterdetermination. The pixels removed are outliers, for example.

One or more clusters can be identified from the remaining pixels havingthe first values. As illustrated, two clusters are identified: a firstcluster 462 corresponding to the first fiducial marker 188 and a secondcluster corresponding to the second fiducial marker 190. A firsthorizontal pixel location 466 (HPL1) and a first vertical pixel location468 (VPL1) at a center of the first cluster 462 is identified as thelocation of the first fiducial marker 188. Additionally, a secondhorizontal pixel location 470 (HPL2) and a second vertical pixellocation 472 (VPL2) at a center of the second cluster 464 is identifiedas the location of the second fiducial marker 190.

In some examples, to identify the first cluster 462 and the secondcluster 464, the fiducial marker analyzer 114 can search the new image460 top to bottom from left to right until a pixel having the firstvalue (e.g., a pixel value of 255) is located. Once located, a 100×100block of pixel (e.g., a block large enough to encompass a cluster) isanalyzed to identify the pixel at the center of the cluster and therespective horizontal and vertical location of that pixel. In someexamples, the pixel at the center is identified by averaging averagehorizontal and vertical location of the pixels in the cluster. Onceidentified, the fiducial marker analyzer 114 can continue to search thenew image 460 to identify the next cluster.

Based on the determined locations of the first fiducial marker 188 andthe second fiducial marker 190, the pixel density 438 and a referenceheight 440 of the subject can be determined. As previously discussed,because most subjects are three-dimensional, a compensation for how thefirst collimated light 184 and the second collimated light 186 reflectsoff of the subject is needed to account for the three-dimensional effectwhen determining the pixel density 338 and the reference height 440. Thecompensation can be dependent on the tilt angle 199 of the camera 104.As one example, the tilt angle 199 can be a 12 degree tilt-down of thecamera 104. Additionally, the compensation can be further dependent onthe first horizontal pixel location 466 (HPL1) relative to the secondhorizontal pixel location 470 (HPL2). For example, the compensationcomputation can differ when the first horizontal pixel location 466(HPL1) is lesser than or equal to the second horizontal pixel location470 (HPL2) versus when the first horizontal pixel location 466 (HPL1) isgreater than the second horizontal pixel location 470 (HPL2).

As one example, when the first horizontal pixel location 466 (HPL1) islesser than or equal to the second horizontal pixel location 470 (HPL2),the pixel density 338 and the reference height 440 of the subject arecomputed as follows:Pixel density=vertical distance 198/(VPL2−VPL1+x*(HPL2−HPL1)),  (1)andReference height of the subject=VPL1−y*(HPL2−HPL1),  (2)

where x is 0.550 and y is 0.55 when the tilt angle 199 is a 12 degreetilt-down.

As another example, when the first horizontal pixel location 466 (HPL1)is greater than the second horizontal pixel location 470 (HPL2), thepixel density 338 and the reference height 440 of the subject arecomputed as follows:Pixel density=vertical distance 198/(VPL2−VPL1−x*(HPL2−HPL1)),  (1)andReference height of the subject=VPL1,  (2)

where x is 0.725 when the tilt angle 199 is a 12 degree tilt-down.

Although FIG. 13 describes determination of the pixel density 338 andthe reference height 440 of the subject specific to when the imagecapture sequence 420A is performed, similar methods to determine thepixel density 338 and the reference height 440 of the subject areperformed when alternative image capture sequences 420B or C orperformed. In such image capture sequences, the single image frame 428that includes the fiducial markers is analyzed, along with one or bothof the subject-illuminated image 424 and the background-illuminatedimage 422.

FIG. 14 is an example of the composite group image 118 generated fromimages of individual subjects 108. In this example, a set of images foreach of four subjects (e.g., Subjects A, B, C, and D) to be included inthe composite group image 118 are captured by the camera 104. Each setof images can include one or more of a background-illuminated image 422,a subject-illuminated image 424, a fiducially marked image 426 and asingle image frame 428. A mask 434 is generated using one or both of thebackground-illuminated image 422 and the single image frame 428. Themask 434 can be applied to the subject-illuminated image 424 to generatean extracted subject image 436. Additionally, the fiducially markedimage 426 or the single image frame 428 can include fiducial markers,and collectively the images within the set can be analyzed to determinelocations of the fiducial markers, where the locations are used tofurther determine a pixel density 438 and a reference height 440 of thesubject in the set of images.

The extracted subject image 436 for each subject can be scaled based onthe determined pixel density 438 and the reference height 440 relativeto determined pixel densities and reference heights of subjects from theother sets of images. For example, Subject D is shorter than Subject C,who is shorter than Subject B, who is shorter than Subject A. If thepixel density 438 and the reference height 440 were not determined andused to scale the extracted subject image 436, then each of the subjectextracted images would be automatically resized such that all thesubjects were of the same height. As one example, Subject A and SubjectB would be resized to appear shorter than they are, whereas Subject Cand Subject D would be resized to appear taller than they are. However,by scaling the extracted subject image 436 based on the determined pixeldensity 438 and the reference height 440, this issue is avoided and eachsubject can be represented accurately with respect to the other subjectsas illustrated by the composite group image.

Additionally, the extracted subject image 436 can be scaled based on aposition of the extracted subject image 436 within the composite groupimage 118. For example, taller subjects, such as Subject A can bepositioned further back than shorter subjects such as Subject D.Subjects that are positioned forward such as Subject D can be scaledslightly larger than subjects positioned further back to simulate theeffects of being closer to a lens of a camera.

FIG. 15 is another example of the composite group image 118 generatedfrom images of individual subjects 108. For each subject, the extractedsubject image 436 is generated and the pixel density 438 and thereference height 440 are determined in a similar manner as described inFIG. 13. The extracted subject image 436 for each subject is then scaledbased on the determined pixel density 438 and the reference height 440relative to determined pixel densities and reference heights of subjectsfrom the other sets of images as described in FIG. 13. Additionally, theextracted subject image 436 can be scaled based on a position of theextracted subject image 436 within the composite group image 118. Forexample, as illustrated, the composite group image 118 can includemultiple rows 480 of subjects. Taller subjects such as Subject A andSubject B are often arranged in a row toward the back, while shortersubjects such as Subject C and Subject D are arranged in a row towardthe front. Scaling factors for the extracted subject image 436 can thenbe based on a row in which the subject is to be arranged in order toachieve a more natural look. For example, subjects in a front row may bescaled slightly larger than subjects in a back row to simulate theeffects of being closer to a lens of a camera.

The various examples and teachings described above are provided by wayof illustration only and should not be construed to limit the scope ofthe present disclosure. Those skilled in the art will readily recognizevarious modifications and changes that may be made without following theexamples and applications illustrated and described herein, and withoutdeparting from the true spirit and scope of the present disclosure.

What is claimed is:
 1. A computer-implemented method comprising:receiving a fiducially marked image of a subject that is captured by acamera while the subject is illuminated with at least a first collimatedlight and a second collimated light parallel to the first collimatedlight, the fiducially marked image including a first fiducial markerformed on the subject by the first collimated light and a secondfiducial marker formed on the subject by the second collimated light;determining a first location of the first fiducial marker; determining asecond location of the second fiducial marker; determining a pixeldensity of the fiducially marked image and a reference height of thesubject based on the first location, the second location, and acompensation for a three-dimensional shape of the subject; receiving atleast one other image of the subject captured by the camera; andgenerating a photography product using the at least one other image, thepixel density of the fiducially marked image, and the reference heightof the subject.
 2. The method of claim 1, wherein determining the firstlocation of the first fiducial marker and the second location of thesecond fiducial marker further comprises: creating a new image; for eachpixel of a plurality of pixels in the new image, setting a value of thepixel to a first value or a second value based on a set of conditionsassociated with values of the pixel in a set of images that include thefiducially marked image; resetting the value of one or more pixelshaving the first value that are surrounded by pixels having the secondvalue to the second value; identifying clusters from remaining pixelshaving the first value, a first cluster of pixels corresponding to thefirst fiducial marker and a second cluster of pixels corresponding tothe second fiducial marker; and determining a first horizontal pixellocation and a first vertical pixel location at a center of the firstcluster as the first location of the first fiducial marker and a secondhorizontal pixel location and a second vertical pixel location at acenter of the second cluster as the second location of the secondfiducial marker.
 3. The method of claim 1, wherein the compensation forthe three-dimensional shape of the subject accounts for a location shiftof at least one of the first fiducial marker and the second fiducialmarker included in the fiducially marked image due to thethree-dimensional shape of the subject.
 4. The method of claim 1,wherein: the first location of the first fiducial marker comprises afirst horizontal pixel location and a first vertical pixel location, thesecond location of the second fiducial marker comprises a secondhorizontal pixel location and a second vertical pixel location, and thecompensation is based on at least one of: a relative horizontal pixellocation of the first fiducial marker and the second fiducial marker,and a tilt angle of the camera.
 5. The method of claim 4, furthercomprising: determining the pixel density of the fiducially marked imagebased on a coefficient dependent on the first horizontal pixel locationrelative to the second horizontal pixel location and a vertical distancebetween the first collimated light and the second collimated lightemitted to illuminate the subject.
 6. The method of claim 4, furthercomprising: when the first horizontal pixel location is less than orequal to the second horizontal pixel location, determining the referenceheight of the subject based on the first vertical pixel location, thefirst horizontal pixel location, the second horizontal pixel location,and the tilt angle of the camera.
 7. The method of claim 4, furthercomprising: when the first horizontal pixel location is greater than thesecond horizontal pixel location, determining the reference height ofthe subject as the first vertical pixel location.
 8. A systemcomprising: at least one processor; and a memory coupled to the at leastone processor and storing instructions that, when executed by the atleast one processor, cause the at least one processor to: receive afiducially marked image of a subject that is captured by a camera whilethe subject is illuminated with a first collimated light and a secondcollimated light parallel to the first collimated light, the fiduciallymarked image including a first fiducial marker formed on the subject bythe first collimated light and a second fiducial marker formed on thesubject by the second collimated light; determine a first location ofthe first fiducial marker; determine a second location of the secondfiducial marker; determine a pixel density of the fiducially markedimage and a reference height of the subject based on the first location,the second location, and a compensation for a three-dimensional shape ofthe subject; receive at least one other image of the subject captured bythe camera; and generate a photography product using the at least oneother image, the pixel density of the fiducially marked image, and thereference height of the subject.